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UNITED STATES DISTRICT COURT 
FOR THE DISTRICT OF COLUMBIA 


AMERICAN EDUCATIONAL RESEARCH 
ASSOCIATION, INC., AMERICAN 
PSYCHOLOGICAL ASSOCIATION, INC., and 
NATIONAL COUNCIL ON MEASUREMENT IN 
EDUCATION, INC., 

Plaintiffs, 


PUBLIC.RESOURCE.ORG, 


Case No. l;14-CV-00857-TSC-DAR 

DEFEND ANT-COLTVTERCLAIMANT 
PUBLIC.RESOURCE.ORG, INC.’S 
STATEMENT OF DISPUTED FACTS 
IN OPPOSITION TO PLAINTIFFS’ 
MOTION FOR SUMMARY 
JUDGMENT AND PERMANENT 
INJUNCTION 

Action Filed: May 23, 2014 


Defendant. 


[PUBLIC VERSION] 

Pinsuant to the Local Civil Rule 7(h), Defendant-Coimterclaimant Piiblic.Resomce.Org 
(“Public Resomce”) submits in support of its Motion for Summary Judgment and in Opposition 
to Plaintiffs’ Motion for Simimaiy Judgment and Permanent Injimction, a Statement of Disputed 
Facts to be tried, as follows: 


Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

1. Plaintiffs, AERA, APA, and NCME, are 
District of Cohmibia not-for-profit corporations 
(Levine Dec!., f 4; Eriresto Dec!., ^ 3; Wise 
Decl.,t3). 

Undisputed. 

2. AERA is the major national scientific society 
for research on edircatiou and leaniiug. AERA’s 
mission is to advance knowledge aboirt 
edircation, to encomage scholarly inqiruy 
related to education, and to promote the irse of 
research to improve edircatiou and serve the 
public good (Levine Deck, H 5). 

Undisputed. 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

3. APA is the largest scientific and professional 
organization representing psychology in the 
United States. APA is the world’s largest 
association of psychologists and counts a vast 
nimiber of researchers, educators, clinicians, 
consultants and students among its members. 
APA’s mission is to advance the creation, 
couunimication, and application of 
psychological knowledge to benefit society and 
improve people’s lives (Ernesto Deck, ^ 4). 

Undisputed. 

4. NCME is a professional organization for 
individuals involved in assessment, evaluation, 
testing, and other aspects of educational 
measmemeut. NCME’s members are involved 
in the constraction and use of standardized 
tests; new foixus of assessment, including 
perfomiance-based assessment; progiam 
design; and progiam evaluation (Wise Deck, 

114). 

Undisputed. 

5. Plaintiffs have been preparing and publishing 
versions of the Standards for Educational and 
Psychological Testing for over fifty years. In 
1954, Plaintiff APA prepared and published the 
“Technical Recommendations for Psychological 
Tests and Diagnostic Techniques” (Camara 

Deck, f 7; Ernesto Deck, ^ 5). 

Plaintiffs have failed to adduce admissible 
evidence in support of this fact. 

Disputed to the extent that Plaintiffs imply that 
they developed any portion of the 1999 
Standards. The evidence shows that vohmteers 
and members of the public developed the 1999 
Standards, not the Plaintiffs. (SMF ^ 8-9, 17- 
18.) 

Plaintiffs reftised to provide evidence or 
testimony concerning any edition of the 
Standards other than the 1999 Edition, and 
they redacted docimients that included 
infoiTuation concerning other editions of the 
Standards. Plaintiffs should be precluded fiom 
using claimed evidence that they reftised to 
provide diuing discovery. 

See ICE Ex. 63 (Plaintiffs/coimterclaim- 
defendants’ Objections and Answers to 
Defendant/coimterclaim-plaintiff’s First Set of 
Intenogatories (Nos. 1-10) (objecting to 
production of docmnents concerning any 
publications other than the 1999 Standards and 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 


stating that sirch docirments are irrelevant)); 

ICE Ex. Ex. 62 (correspondence PRO coimsel 
identifying earlier versions and redactions as 
issues in discovery). 

6. In 1955, Plaintiffs AERA and NCME 
prepared and published a companion document 
entitled, “Technical Recommendations for 
Achievement Tests” (Levine Decl., ^ 6; Camara 
Decl., 1 7; Wise Decl., 1 5). 

Plaintiffs have failed to addirce admissible 
evidence in sirpport of this fact. 

Disputed to the extent that Plaintiffs imply that 
they developed any portion of the 1999 
Standards. Vohmteers and members of the 
pirblic developed the 1999 Standards, not the 
Plaintiffs. (SMF t 8-9, 17-18.) 

Disputed to the extent that Plaintiffs reftrsed to 
provide evidence or testimony concerning any 
edition of the Standards other than the 1999 
Edition, and redacted docirments that included 
information concerning other editions of the 
Standards. Plaintiffs should not be allowed to 
now testify on matters they reftrsed to allow 
discovery into. See ICE Ex. 63 
(Plaintiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/coimterclaim-plaintiffs First Set of 
Intenogatories (Nos. 1-10) (objecting to 
production of docirments concerning any 
publications other than the 1999 Standards and 
stating that such documents are irrelevant)); 

ICE Ex. Ex. 62 (correspondence PRO coimsel 
identifying earlier versions and redactions as 
issues in discovery). 

7. Subsequently, a joint committee of the three 
organizations modified, revised, and 
consolidated the two documents into the first 
Joint Standards. Beginning with the 1966 
revision, the three organizations (AERA, APA 
and NCME - collectively, the “Sporrsoring 
Organizations”) collaborated in developing the 
“Joint Standards” (or simply, the “Standards”). 
Each srrbseqrrent revision of the Standards has 
been carefitl to note that it is a revision and 
update of the prior version (Levine Decl., ^ 6; 
Camara Decl., f 7; Ernesto Decl., ^ 6; Wise 

Plaintiffs have failed to adduce admissible 
evidence in support of these facts. 

Disputed to the extent that Plaintiffs imply that 
they developed any portion of the 1999 
Standards. Vohmteers and members of the 
public developed the 1999 Standards, not the 
Plaintiffs. (SMF 8-9, 17-18.) 

Disputed to the extent that Plaintiffs reftrsed to 
provide evidence or testimony concerning any 
edition of the Standards other than the 1999 
Edition, and redacted documents that included 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

Decl.,t6). 

information concerning other editions of the 
Standards. Plaintiffs shorrld not be allowed to 
now testify on matters they reftrsed to allow 
discovery into. See ICE Ex. 63 
(Plaiutiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/coimterclaim-plaintiff s Fust Set of 
Intenogatories (Nos. 1-10) (objecting to 
prodirction of docmnents concerning any 
pirblications other than the 1999 Standards and 
stating that sirch docirments are irrelevant)); 

ICE Ex. Ex. 62 (correspondence PRO coimsel 
identifying earlier versions and redactions as 
issires in discovery). 

8. Beginning in the mid- 1950s, the Sponsoiing 
Organizations foiiued and periodically 
reconstihited a committee of highly trained and 
experienced experts in psychological and 
educational assessment, charged with the initial 
development of the Teclmical 

Recommendations and then each subsequent 
revision of the (renamed) Standar ds. These 
conunittees were formed by the Sponsormg 
Organizations’ Presidents (or theh designees), 
who would meet and jointly agree on the 
membership. Often a chair or co-chaii s of these 
conunittees were selected by joint agreement. 
Begiiming with the 1966 version of the 

Standards, this committee became referred to as 
the “Joint Committee” (Levine Decl., 7; 

Camara Decl., 8; Ernesto Decl., ^ 7; Wise 

Decl., 17). 

Plaintiffs have failed to addirce admissible 
evidence in sitpporf of these facts. 

Dispirted to the extent that Plaintiffs imply that 
they developed any portion of the 1999 
Standards. Vohmteers and members of the 
pirblic developed the 1999 Standards, rrot the 
Plaintiffs. (SMF 1 8-9, 17-18.) 

Disputed to the extent that Plaintiffs reftrsed to 
provide evidence or testimony concerning any 
edition of the Standards other than the 1999 
Edition, and redacted docirments that included 
information concerning other editions of the 
Standards. Plaintiffs shorrld not be allowed to 
now testify on matters they reftrsed to allow 
discovery into. See ICE Ex. 63 
(Plaintiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/coimterclaim-plaintiff s Fust Set of 
Interrogatories (Nos. 1-10) (objecting to 
production of docmnents concerning any 
publications other than the 1999 Standards and 
stating that such docirments are inelevant)); 

ICE Ex. Ex. 62 (correspondence PRO coimsel 
identifying earlier versions and redactions as 
issues in discovery). 

9. Financial and operational oversight for the 
Standards’ revisions, promotion, distribution. 

Undisputed but unmaterial. 


4 


Case l:14-cv-00857-TSC Document 69-3 Filed 01/21/16 Page 5 of 47 


Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

and for the sale of the 1999 and 2014 Standards 
has been imdeitaken by a periodically 
reconstituted Management Committee, 
comprised of the designees of the three 
Sponsoiing Organizations (Levine Decl., ^ 8; 
Camara Deck, ^ 9; Schneider Deck, ^ 4; 

Ernesto Deck, f 8; Wise Deck, ^ 8). 


10. All members of the Joint Committee(s) and 
the Management Committee(s) are unpaid 
vohmteers. The expenses associated with the 
ongoing development and publication of the 
Standards include travel and lodging expenses 
(for the Joint Committee and Management 
Coimnittee members), support staff time, 
printing and shipment of boimd vohnnes, and 
advertising costs (Levine Deck, ^ 9; Camara 
Deck, f 10; Schneider Deck, f 5; Eriresto Deck, 

If 9; Wise Deck, 1 9). 

Undisprrted. Second sentence immaterial. 

1 1 . Many different fields of endeavor rely on 
assessments. The Sponsoring Organizations 
have ensiued that the range of these fields of 
endeavor is represented in the Joint 

Cormnittees’ membership — e.g., admissions, 
achievement, clinical coimseling, edircational, 
licensing-credentialing, employment, policy, 
and program evahration. Similarly, the Joint 
Corrmiittee’s members, who are unpaid 
volunteers, represent expertise across major 
fimctional assessment areas - e.g., validity, 
eqrrating, reliability, test development, scoring, 
reporting, interpretation, and large scale 
interpolation (Levine Deck, 1 10; Ernesto Deck, 

If 10; Wise Deck, If 10). 

Undisprrted. 

12. From the time of their initial creation to the 
present, the preparation of and periodic 
revisions to the Standards entail intensive labor 
and considerable cross-disciplinary expertise. 
Each time the Standards are revised, the 
Sponsoring Organizations select and arrange for 
meetings of the leading arrthorities in 
psychological and educational assessments 

Undisprrted birt immaterial. 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

(known as the Joint Committee). Dining these 
meetings, certain Standards are combined, 
pared down, and/or augmented, others are 
deleted altogether, and some aie created as 
whole new individual Standards. The 1999 
version of the Standards is nearly 200 pages, 
took more than five years to complete (Levine 
Deck, 11 1 1; Ernesto Deck, 1 1 1; Camara Deck, 

If 11). 


13. The 1999 Standards is the result of work put 
in by the Joint Committee to generate a set of 
best practices on educational and psychological 
testing that are respected and relied upon by 
leaders in then' fields (Camara Deck, If 1 1; Wise 

Deck, nil). 

Undisputed. 

14. Draft revisions of the 1985 Standards, for 
what became the 1999 Standards, were widely 
distributed for public review and conunent three 
times dining this revision effort to gauge 
whether the testing cormnimity believed the 
revised dr afts to be ciuient and inclusive of the 
topics at issue (Schneider Deck, If 6). 

Undisputed. 

15. The Joint Committee received thousands of 
pages of comments and proposed text revisions 
fi'om: the membership of the Sponsoring 
Organizations, scientific, professional, hade and 
advocacy groups, credentialing boards, state 
and federal goveiimient agencies, test 
publishers and developers, and academic 
instihitions. While the Joint Committee 
reviewed and took imder advisement these 
helpfiil conunents, the final language of the 

Disputed. Many of the thousands of pages of 
comments and proposed text revisions fiom 
members of the public and government were in 
fact incorporated into the 1999 Standards. See 

1999 Standards was a product of the Joint 
Committee members (Camara Deck, 1[ 12; 
Schneider Deck, f 7). 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

16. When the 1985 Standards were revised, 
more than half the content of the 1999 

Standards resulted from newly written prose of 
the Joint Committee (Camara Decl., 12). 

Disprrted to the extent that Plaintiffs imply that 
all of tliis text was original to the Joint 
Committee, when mrtch of it was in fact taken 
fr om proposed text sirbmitted by members of 
the prtblic and government. See SMF 9; 



17. The Standards originally were created as 
principles and guidelines - a set of best 
practices to improve professional practice in 
testing and assessment across multiple settings, 
including education and various areas of 
psychology. Tlie Standards can and should be 
used as a recoumieuded comse of action in the 
soimd and ethical development and use of tests, 
and also to evaluate the quality of tests and 
testing practices. Additionally, an essential 
component of responsible professional practice 
is maintaining technical competence. Many 
professional associations also have developed 
standards and principles of technical practice in 
assessment. The Sponsoring Organizations’ 
Standards have been and still are used for this 
piupose (Geisinger Decl., 1 18; Camara Decl., 

1 13; Wise Decl., 1 12). 

Undisprrted. 

18. The Standards, however, are not simply 
intended for members of the Sponsoring 
Organizations, AERA, APA, and NCME. The 
intended audience of the Standards is broad and 
cuts across audiences with varying backgrounds 
and different trainurg. For example, the 

Standards also are intended to grride test 
developers, sponsors, pitblishers, and rrsers by 
providing criteria for the evaluation of tests, 
testing practices, and the effects of test rrse. Test 
rrser standards refer to those standards that help 
test rrsers decide how to choose certain tests, 
interpret scores, or make decisions based on 

Disprrted to the extent that Plaintiffs imply that 
the 1999 Standards are not enforceable as law. 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

tests results. Test users include clinical or 
industrial psychologists, research duectors, 
school psychologists, counselors, employment 
supei'visors, teachers, and various 
administrators who select or inteipret tests for 
then organizations. There is no mechanism, 
however, to enforce compliance with the 
Standards on the part of the test developer or 
test user. The Standards, moreover, do not 
attempt to provide psychometric answers to 
policy or legal questions (Camara Dec!., T[ 14; 
Wise Decl., 113; Geisinger Decl., 119; Ernesto 
Decl.,112). 


19. The Standards promote the development of 
high quality tests and the soimd use of results 
from such tests. Without such high quality 
standards, tests might produce scores that are 
not defensible or accmate, not an adequate 
reflection of the characteristic they were 
intended to measine, and not fan to the person 
tested. Consequently, decisions about 
individuals made with such test scores would be 
no better, or even worse, than those made with 
no test score information at all. Thirs, the 
Standards help to ensine that measines of 
stirdent achievement are relevant, that 
admissions decisions are fan, that employment 
hhing and professional crederrtialing resirlt in 
qrtalified individrrals bemg selected, arrd 
patients with psychological needs are diagnosed 
properly and treated accordingly. Qrrality tests 
protect the prrblic from hannfrtl decision 
making and provide opporfimities for edircation 
and employment that are fan to all who seek 
them (Canrara Deck, 115; Wise Deck, 1 14). 

Dispirted to the exterrt Plamtiffs seek to 
establish copyrightability of the Standards. 
Plaintiffs have failed to addirce admissible 
evidence in srrpporf of these facts. These are 
not facts birt opinions. Plaintiffs provide no 
soince other than Mr'. Camara and Mr. Wise’s 
conjectines to srrpporf these statements. 

Neither of them are qiralifred as experts. 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

20. The Standards apply broadly to a wide 
range of standardized instnunents and 
procedmes that sample an individuaTs 
behavior, including tests, assessments, 
inventories, scales, and other testing vehicles. 

The Standards apply equally to standardized 
multiple-choice tests, perfonnance assessments 
(including tests comprised of only open-ended 
essays), and hands-on assessments or 
sunulations. Tlie main exceptions aie that the 
Standards do not apply to imstandardized 
questioimaiies {e.g., imstnictmed behavioral 
checklists or observational foims), teacher- 
made tests, and subjective decision processes 
(e.g., a teacher’s evaluation of students’ 
classroom pariicipation over the coiuse of a 
semester) (Camara Deck, 16; Wise Deck, 

Tf 15; Geisinger Deck, ^ 20; Ernesto Deck, 

1113). 

Undispirted. 

2 1 . The Standards have been used to develop 
testing guidelines for such activities as college 
admissions, personnel selection, test 
translations, test user qualifications, and 
computer-based testing. The Standards also 
have been widely cited to address technical, 
professional, and operational noiins for all 
foiins of assessments that are professionally 
developed and used in a variety of settings. The 
Standards additionally provide a valuable public 
seiwice to state and federal goveirmients as they 
vohmtarily choose to use them. For instance, 
each testing company, when submitting 
proposals for testing admmistiation, instead of 
relying on a patchwork of local, or even 
individual and proprietary, testing design and 
implementation criteria, may rely instead on the 
Sponsoring Organizations’ Standards to afford 
the best giridance for testing and assessment 
practices (Camara Deck, HIT; Wise Deck, f 16; 
Geisinger Deck, If 21; Ernesto Deck, Tf 14). 

Undispirted. 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

22. The Standards were not created or updated 
to serve as a legally binding document, in 
response to an expressed goveimuental or 
regulatoiy need, nor in response to any 
legislative action or judicial decision. However, 
the Standards have been cited injudicial 
decisions related to the proper use and evidence 
for assessment, as well as by state and federal 
legislators. Tliese citations injudicial decisions 
and dining legislative deliberations occimed 
without any lobbying by the Plaintiffs (Levine 
Decl., ^ 12; Camara Decl., If 18; Ernesto Dec!., 

If 15; Wise Decl., 1 17). 

Disputed. Plaintiffs have failed to adduce 
admissible evidence in support of these facts. 
Plaintiffs cite no evidence concerning the 
piuposes for the creation or revision of the 

1999 Standards, and they could not establish 
the purposes behind every contribution from 
the thousands of people and entities who 
contributed to the development and revision of 
the Standards. This is particularly the case for 
contributions by governmental entities. Tire 

APA lobbied for the 1999 Standards to be 
mandated in legislation that was deliberated by 
Congress. (SMF | 52-55; ICE Exs. 31,^M 



23. Dining the discovery phase of this litigation, 
however. Plaintiff APA located in its archives 
conespondence relating to APA’s support for 
proposed legislation souglit to be introduced in 
2001 by Senator Paul Wellstoue (D-MN) on 
Fairness and Accinacy in High Stakes 
Educational Decisions for Students - a 
suggested amendment to the Elementary and 
Secondary Education Act (“No Child Left 

Behind Act”) 147 Cong. Rec. S. 4,644 (daily 
ed. May 9, 2001) (Ernesto Deck, ^Tf 16-22, 

Exhs. NN-SS). 

Undisputed. 

24. Some of APA’s letters are imsigned and are 
not printed on APA letterhead. Therefore, in 
accordance with APA practices and protocols, it 
is likely that the imsigned letters (not printed on 
letterhead) were internal discussion drafts that 
were never sent (Ernesto Deck, ^ 23). 

Disputed. Plaintiffs have failed to adduce 
admissible evidence in support of these alleged 
“facts,” which are achially opinions. Plaintiffs 
provide no soiuce other than Ms. Ernesto’s 
conjectiues to support these statements, have 
not provided any proof of “APA practices and 
protocols” as they concern letters sent by 

APA’s lobbyists, and Ms. Ernesto’s statements 
in her declaration ar e contradicted by her 
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Plaintiffs’ Statement of Material Facts 


Defendant Public Resource’s Response 



25. Regaiding the signed letters that were 
printed on APA letterhead, they relate to 
Senator Wellstone’s proposed legislation that 
tests and assessments administered by the states 
are of high quality and used appropriately for 
the benefit of test administrators and test takers. 
These are goals that are consistent with APA 
policy as then reflected in the 1999 Standards. 
Even though Senator Wellstone’s amendments 
sought, in part, to mandate states’ compliance 
with the Standards, none of the Sponsoring 
Organizations actively advocated for this - and 
in any event Senator Wellstone’s proposed 
amendment mcluding this language was never 
enacted into law (Ernesto Deck, ^ 24, Exh. XT). 


However, a document produced by APA 
proves that at least one such lobbying letter 
was sent: Exhibit SS to Ms. Ernesto’s 
declaration is a 2002 memorandimi APA 
produced titled “Highlights of APA’s 
Involvement m Educational Testing Provisions 
of the ‘No Child Left Behind Act,”’ that 
describes APA’s lobbying work at the time. 
This memorandimi includes the ftill text of a 
letter that APA sent on May 7, 2001 to U.S. 
Senators lobbying for the mandating of the 
1999 Standards thiough an amend ment b^ 
Senator Wellstone. At deposition. 



Disputed. Plaintiffs have failed to adduce 
admissible evidence in support of these facts. 
Plaintiffs have no evidence to support theft 
statement that “none of the Sponsoring 
Organizations actively advocated for 
[legislation mandating the 1999 Standards],” 
other than Ms. Ernesto’s conjectiue in her 
declaration ^ 24, which is contradicted by her 
deposition testimony and by the documents she 
attaches as Exhibits QQ an d SS to her 
declaration. At deposition. 
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Plaintiffs’ Statement of Material Facts 


Defendant Public Resource’s Response 



letter was sent; Exhibit SS to Ms. Ernesto’s 
declaration is a 2002 memorandum APA 
produced titled “Highlights of APA’s 
Involvement in Educational Testing Provisions 
of the ‘No Child Left Behind Act,”’ that 
describes APA’s lobbying work at the time. 
This memorandimi includes the ftill text of a 
letter that APA sent on May 7, 2001 to U.S. 
Senators lobbying for the mandating of the 



26. APA’s search of its records did not disclose 
any ftuther commimications with Congiess 
relating to the Standards and, to the best of 
APA’s knowledge, it has not engaged in 
connnimications with Congress regarding 
citation of the Standards in legislation since 
2001 (Ernesto Deck, f 25). 


27. Moreover, neither AERA nor NCME has 
ever commimicated with Congiess for the 
piupose of encoiuaging the enactment of the 
Standards into law (Levine Deck, 12-13; 
Wise Deck, ^ 18). 



organizations put on an event at the Russell 
Senate Office Building on Capitol Hill about 
the 2014 Standards. ICE Exs. 47-49, and| 


Disputed. Plaintiffs have no evidence to 
support this statement other than the conjecture 
of Dr. Levine and Dr. Wise. Moreover, all 
thiee plaintiff organizations organized and 
paiticipated in an event at the Russell Senate 
Office Building on Capitol Hill about the 2014 
Standards. ICE Exs. 47-49, and^^^^H 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

28. None of the Sponsoring Organizations has 
solicited any goveiimient agency to incoiporate 
the Standar ds into the Code of Federal 
Regulations or other niles of Federal or State 
agencies (Levine Dec!., ][ 13; Ernesto Dec!., 

Disputed. Plaintiffs have failed to adduce 
admissible evidence m support of these facts. 
Plamtiffs have no evidence to sirpport this 
statement other than the conjectme of 

Dr. Levine, Ms. Ernesto, and Dr. Wise. At 

K 26; Wise Dec!., 1 19). 

deposition, 



29. Rather, in the policymaking arena, the 
Sponsoring Organizations believe the Standards 
should be treated as guidelines mfoiiuuig the 
enactment of legislation and regulations 
consistent with best practices in the 

Plaintiffs’ self-serwing profession of “belief’ is 
not a material fact. Moreover, disputed to the 
extent that Plaintiffs do not specify a time 
frame for this belief They may believe this 
now, but in the past 

development and use of tests - to insiue that 
they are valid, reliable and fair (Wise Decl., 

^ 20; Ernesto Decl., ^ 27). 

^^^^^^^^^^^■Pl^tiffs also orgarrized 
an event on Capitol Hill aboirt the 2014 
Starrdards as recently as September 2014. ICE 

30. Plamtiffs promote and sell copies of the 
Standards via refeiials to the AERA website, at 
annual meetmgs, in public offerings to shidents, 
and to educational institution faculty. 
Advertisements promoting the Standards have 
appeared in meeting brochmes, in scholarly 
joimials, and in the hallways at professional 
meetmgs (Levine Decl., 1 14, Exh. NNN; 

Dispirted to the extent that Plaintiffs did not 
sell copies of the 1999 Standards for 
approximately one year dining this litigation, 
they do not promote the 1999 Standards or 
earlier editions, and they do not sell ear lier 
editions of the Standards. Plfs Mem, at 1 1;^B 

Eiuesto Decl., f 28, Exh. UU; Wise Decl., ^ 21, 
Exh. KKK). 
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Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 

3 1 . All copies of the Standards bear a copyright 
notice (Levine Decl., 15, 28, Exh. TXT). 

Disputed to the extent that Plaintiffs refer to 
any edition of the Standards other than the 

1999 edition, which is the only edition that 
Plaintiffs have provided evidence as to the 
placement of a copyright notice. Moreover, 
the 1999 edition is the only edition at issue in 
this litigation, and Plaintiffs have refrised to 
allow discovery into other editions of the 
Standards. See ICE Ex. 63 
(Plaintiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/coimterclaim-plaintiffs First Set of 
Intenogatories (Nos. 1-10) (objecting to 
production of docmnents concerning any 
publications other than the 1999 Standards and 
stating that such documents are uielevant)); 

ICE Ex. Ex. 62 (correspondence PRO coimsel 
identifying earlier versions and redactions as 
issues in discovery). 

32. Disti'ibution of the Standards is closely 
monitored by the Sponsoruig Organizations. 
AERA, the designated publisher of the 

Disputed. Distribution of the Standards is not 
closely monitored by the Sponsoring 
Organizations. At deposition, 

Standards, sometimes does provide promotional 
complementary print copies to students or 
professors. Except for these few complementary 
print copies, however, the Standards are not 
given away for free; and certainly they are not 
made available to the pirblic by any of the three 
organizations for anyone to copy fr ee of charge 


(Levine Decl., If 16; Ernesto Decl., ^ 29; Wise 
Decl., 1 22). 


33. To date. Plaintiffs have never posted, or 
arrthorized the posting of, a digitized copy of 
the 1999 Standards on any pirblicly accessible 
website (Levine Decl., f 16; Eriresto Decl., 

30; Wise Decl., t 23). 

Undisputed. 

34. The 1999 Standards have been sold at 
modest retail prices rangmg from $25.95 to 
$49.95 per copy. From 2000 to 2014, except for 
the near two-year period dining which Pirblic 
Resoiuce posted imauthorized copies online and 

Disputed to the extent that sales of the 1999 
Standards peaked in 2002 and have been 
declining since then, and declined more rapidly 
in the year prior to when Pirblic Resoiuce 
posted the 1999 Standards than they did 
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sales diminished significantly, income 
generated from sales of the 1999 Standards, on 
average, had been approximately in excess of 
$127,000 per year (Levine DecL, 17-18 

Exh. OOO). 

subsequent to Public Resoiuce’s actions. 
Additionally, sales of the 1999 Standards 
increased in the year after Public Resomce 
posted the 1999 Standards. (SMF ^ 44, 47.) 

Tlie characterization of the retail prices of the 
1999 Standards as “modest” is an opinion, not 
a fact, and Dr. Levine is not qualified as an 
expert on the subject of the reasonableness of 
pricing for access to the law. 

35. After the 2014 Standards were published in 
the late summer of 2014, AERA for a time 
discontinued sales of the 1999 Standards. This 
was to encoiuage sales of the newly-revised 
edition - the 2014 Standards (Levine Dec!., 

Tf 19, Exh. PPP). However, so long as 
piuchasers are made aware that it is no longer 
the ciment edition, the 1999 Standards do have 
an endming value for those in the testing and 
assessment profession who (i) need to know the 
state of best testing practices as they existed 
between 1999 and 2014, (ii) believe they still 

Disputed that Plaintiffs resmued sale of the 

1999 Standards in 2015 because of the reasons 
asserted. Plaintiffs appear to have resumed 
selling the 1999 Standards to support their 
position in this litigation. This is evident first 
because Plaintiffs have not resumed the sale of 
any other edition of the Standards, even though 
every edition would qualify imder the factors 
that Plaintiffs cite for theu decision to resume 
selling the 1999 edition. Note also that the 

1985 Standards were incorporated by reference 
into 34 CFR § 668.148 from 1995 rmtil 2010, 

may be held accoimtable to the guidance of the 
1999 Standards even now, and/or (iii) study the 
changes in best testing and assessment practices 
over time. For these reasons, in the summer of 
2015 AERA resumed sales of the 1999 

Standards (Levine Deck, 20, Exh. QQQ). 

^^^^^^l^^meover, although AERA states 
that it has made the 1999 Standards available 
for pruchase once more, imlike the 2014 
Standards and AERA’s other publications, the 
1999 Standards are not available for pruchase 
tluough AERA’s orrline store; instead, 
prospective pruchasers are reqirired to fill orrt a 
special book order form and deliver the form 
to AERA for processing. (SMF ^ 60.) 
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36. The Sponsoring Organizations do not keep 
any of the proceeds generated from the sales of 
the Standards. Rather, the income from these 
sales is used by the Sponsoring Organizations 
to offset their development and production costs 
and to generate frmds for subsequent revisions. 
This allows the Sponsoring Organizations to 
develop up-to-date, high quality Standards that 
otheiwise would not be developed due to the 
time and effoil that goes into producing them 
(Levine Deck, 1 21; Geisinger Deck, ^ 22; 
Camara Deck, If 19; Ernesto Deck, ^ 31). 

Disputed to the extent that Plaintiffs assert that 
the development of the Standards would not 
have occimed but for the particular revenue 
model that Plaintiffs employ. This is an 
opinion, not a fact. Plaintiffs have no evidence 
to support this assertion other than the 
conjectme of then witnesses. Dr. Levine, 

Ml'. Camara, and Ms. Ernesto aie not qualified 
as experts to opine on this subject. 

Dr. Geisinger is not an expert on revenue 
models or standards development, and is not 
qualified to opine on this subject. See Public 
Resoince’s Motion to Strike the Declaration of 
Dr. Geisinger, Dkt 67. 

37. Without receiving at least some moderate 
income from the sales of the Standards to offset 
then production costs and to allow for fruther 
revisions, it is very likely that the Sponsoring 
Organizations would no longer imdeilake to 
periodically update them, and it is unknown 
who else would (Levine Deck, ^ 22; Ernesto 
Deck, ][ 32; Wise Deck, ^ 24; Geisinger Deck, 
122). 

Disputed. Plaintiffs have failed to adduce 
admissible evidence in support of these alleged 
“facts.” These are opinions, not facts. 

Dr. Levine, Mi'. Camara, and Ms. Ernesto are 
not qualified as experts to opine on this 
subject. Dr. Geisinger is not an expert on 
revenue models or standards development, and 
is not qualified to opine on this subject. See 
Public Resoiu'ce’s Motion to Stiike the 
Declaration of Dr. Geisinger, Dkt. 67. 

Moreover, the 2014 Standaids are not 
implicated by this litigation, and Plaintiffs 
vohmtaiily stopped selling the 1999 Standards, 
the only edition at issue. Plaintiffs have 
provided no evidence as to how Public 
Resource’s posting of the 1999 Standards 
could harm Plaintiffs’ income from the 2014 
Standards, far fr om reducing revenue from the 
2014 Standards to less that “some moderate 
income.” 
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38. At one time, firnding for the Standards 
revision process from thud party soiuces (e.g., 
governmental agencies, foimdations, other 
associations interested in testing and assessment 
issues, etc.) was considered. However, this 
option was not seriously considered as the 
difficulty and/or potential conflicts of interest in 
doing so left the Sponsoring Organizations to 
conclude that financial support for the 

Standards revisions should be self-fimdmg - 
that is, fi'oin the sale of prior editions of the 
Standards (Levine Decl., ^ 23; Camara Decl., 
1120). 

Undisputed but immaterial. 

39. Due to the small membership size of 

Plaintiff NCME, and the relative minor portion 
of the membership of Plaintiffs AERA and 

APA who devote then careers to testing and 
assessment, it is highly imlikely that the 
members of the Sponsoring Organizations will 
vote for a dues increase to fimd futine 

Standards revision efforts if Rrblic Resoince 
successfiilly defends this case and is allowed to 
post the Standards onlme for the public to 
download or print for free. As a result, the 
Sponsoring Organizations would likely abandon 
then practice of periodically updating the 
Standards (Levine Deck, ^ 24; Camara Deck, 

If 24; Geisinger Deck, If 23; Ernesto Deck, 

133). 

Disputed but inunateiiak Plamtiffs have failed 
to adduce admissible evidence in support of 
these alleged “facts.” These are opinions, not 
facts. Dr. Levme, Mi'. Camara, and Ms. 

Ernesto are not qualified as experts to opine on 
tliis subject. Dr. Geisinger is not an expert on 
revenue models or standards development, and 
is not qualified to opine on this subject. See 
Public Resoince ’s Motion to Strike the 
Declaration of Dr. Geismger, Dkt. 67. 

Moreover, the 2014 Standards are not 
unplicated by this litigation, and Plaintiffs 
vohmtarily stopped selling the 1999 Standards, 
the only edition at issue. (SMF ^ 40; Plfs Mem. 
at 11.) Plaintiffs have provided no evidence as 
to how Public Resoince’s posting of the 1999 
Standards could harm Plaintiffs’ income fi'om 
the 2014 Standards. Additionally^laintiff^^ 
claims defi^ reason. 


17 


Case l:14-cv-00857-TSC Document 69-3 Filed 01/21/16 Page 18 of 47 


Plaintiffs’ Statement of Material Facts 

Defendant Public Resource’s Response 





40. The Plaintiffs are joint owners of the 
copyiight in and to the Standards. The 

Standards were registered with the U.S. 

Register of Copyr ights rmder Registration 
Nrnuber TX 5-100-196, having an effective date 
of December 8, 1999 (Levine Dec!., ][ 25, 

Exh. RRR). 

Disprrted to the exterrt that Plaintiffs claim to 
be joint owners of the copyright to the 1999 
Standards. The copyright registration is false, 
as Plaintiffs have admitted, becairse it does not 
list the names of the claimed other joint 
airthors of the 1999 Standards: both the fust 
registration, obtained m December 1999, and 
the srrpplementary registration, obtained in 
Febnrary 2014, list either AERA or all tluee 
Plaintiffs as the sole airthors and owners of the 
1999 Standards, birt only months later did 
Plaintiffs obtain then first alleged copyright 
assigrmient (in April 2014). ICE Ex. 3 (Ernesto 
Dep. 122:23-127:12). Plaintiffs have 
additional fairlts in their' ownership claims. 

The Joint Committee for the 1999 Standards 
comprised 17 members, not 16 as Plaintiffs 
suggest below, and Plaintiffs only allege to 
have assigmnents fr om 15 of those individirals. 
Compare Plfs SMF f 42 with ICE Exs. 12 and 

3 (Er'nesto Dep. 103:22-105:07). Additionally, 
Plaintiffs do not have assignments from any of 
the himdr eds of other individirals, 
organizations, and other entities that 
participated in the development of the 1999 
Standards in collaboration with the Joint 
Committee members. ICE Ex. 2 (Schneider 

Dep. 177:18-178:02). Moreover, the effect of 
the alleged assigmnents and “posthumous 
assigrmients” (for which there was no 
consideration) is a legal issue in dispute. 


the 

assignments were in proper form. Plaintiffs 
have not established that the individirals who 
signed them had ownership of, and the right to 
transfer, the copyrights that they pmport to 
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tr ansfer; many of the members of the Joint 
Committee were employed by entities that 

41. A supplementaiy cop 5 Tight registration for 
the Standards was issued by the U.S. Register 
of Copyr ights luider Supplementary 

Registration Nimiber TX 6-434-609, having an 
effective date of February 25, 2014 (Levine 

Decl., 1 26, Exh. SSS). 

Undispirted. 

42. The Joint Corrmrittee that airthored the 1999 
Standards comprised 1 6 members (Levine 

Decl., ITl 27-28, Exh. TTT). Except for Manfred 
Meier (who coirld not be located, nor coirld his 
heirs), work rnade-for-hire letters were signed 
by 13 Joint Couunittee Members, and 
posthirmous assignments were signed by the 
heirs of 2 deceased Jomt Committee Members, 
vesting ownership of the copyr ight to the 1999 
Standards in the Sponsoring Organizations 
(Ernesto Deck, ^ 34, Exhs. W-HHH). 

Dispirted. The Joint Committee for the 1999 
Standards comprised 17 members, not 16. ICE 
Exs. 12 and 3 (Ernesto Dep. 103:22-105:07) 
Additionally, Plaintiffs fail to mention that 
himdreds of mdividirals, organizations, and 
other entities participated irr the airthorship of 
the 1999 Standards along with the Joirrt 
Committee members. ICE Ex. 2 (Schneider 

Dep. 177:18-178:02); see SMF ^ 9. Moreover, 
the effect of the alleged “work made-for-hii e 
letters” and “posthirrnoirs assigmnents” is a 
legal issite in dispirte, on which Ms. Ernesto’s 
opirriou is not determinative, arrd it is 
mconsistent with Plaintiffs’ claimed “joint 
airthorship.” 
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43. Government agencies also use standards, 
including by incorporating them by reference in 
statutes and regulations. The National 
Technology Transfer and Advancement Act of 
1995 (“NTTAA”), for example, requues federal 
agencies to use privately developed standards 
whenever possible. Pub. L. No. 104-113 § 12, 

1 10 Stat. 775, 782-83 (1996), codified at 

15 U.S.C. § 272. 

Undisputed. 

44. In alignment with the NTTAA, the 
Department of Education used privately 
developed standards in Section 668.146 of 

Title 34 of the Code of Federal Regulations, 
Subtitle B; Regulations of the Offices of the 
Department of Education, Chapter VI: Office of 
Postsecondaiy Education, Department of 
Education Part 668: Student Assistance General 
Provisions, Subpart J: Approval of 

Independently Administered Tests; 

Specification of Passing Score; Approval of 

State Process (the “Department of Education 
Regulations”), in relevant part, provides: 

(a) Except as provided m § 668.148, the 
Secretary approves a test imder this subpait 
if- 

(1) The test meets the criteria set forth in 
paragr aph (b) of this section ... 

(b) To be approved imder this subpait, a test 
must - 

Undisputed. 

(6) Meet all standards for test construction 
provided in the 1999 edition of the 

Standards for Educational and 

Psychological Testing, prepared by a joint 
coimnittee of the American Educational 
Research Association, the American 
Psychological Association, and the National 
Coimcil on Measiuement in Education 
incorporated by reference in this section. 
Incorporation by reference of this document 
has been approved by the Dir ector of the 
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Office of the Federal Register pm suant to 
the Director’s authoritv imder 5 U.S.C. 

SS2(a) and 1 CFR part 5 1 . The incorporated 
docimient is on file at the Depailinent of 
Education, Federal Student Aid, room 

1 13E2, 830 First Street, NE., Washington, 

DC 20002, phone (202) 377-4026, and at 
the National Archives and Records 
Administration (NARA). For information 
on the availability of this material at NARA, 
call 1-866-272-6272, or go to; 
httn : //WWW . archives . so v/ federa 1- 
resister/code-of-federal-resirlations/ibr- 

locations.htrul. The docimient also rnav be 
obtained from the American Edircational 
Research Association at; 
httr);//www.aera.net .... 


45. It is notable that Plaintiffs’ 1999 Standards 
are referred to by way of citation in the U.S. 
Department of Edircation Regulations. 

However, the text of Plaintiffs’ Standards is not 
integr ated word-for-word, in whole or in part, 
into those regirlations. Tlierefore, no one coirld, 
or shoirld, interpret the Standards as “the law.” 

Dispirted to the extent it states facts; legal 
argirment is not factual. The 1999 Standards 
are formally incorporated by reference into the 
U.S Department of Education Regulations in 
flrll, and compliance with all of the 1999 
Standards is thereby mandated by law - it is 
not simply “referred to by way of citation,” as 
Plaintiffs claim. The Office of the Federal 
Register states; “The legal effect of 
incorporation by reference is that the material 
is treated as if it were pirblished in the Federal 
Register and CFR. This material, like any other 
properly issired rule, has the force and effect of 
law. Congress authorized incorporation by 
reference in the Freedom of Information Act to 
redirce the vohrme of material pirblished in the 
Federal Register and CFR.” (SMF 131.) 
Plaintiffs’ statement that “no one could, or 
should, interpret the Standards as ‘the law’” is 
not a fact, it is an opinion (and in part a legal 
conclusion), and Plaintiffs do not cite any 
evidence to support this claim. 

46. On the other hand, the Department of 
Education Regulations are in compliance with 
Federal law - which reqirires that materials 

Nonfactiral legal argirment; disputed. The 

1999 Standards are not reasonably available to 
the class of persons affected. The regulations 
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incoiporated by reference in the Federal 

Register must be “reasonably available to the 
class of persons affected.” 5 U.S.C. § 552(a)(1); 

1 C.F.R. § 51.7(a)(3). 

specify that the 1999 Standards are available to 
read by written appomtment at the National 
Archives in Washington D.C., or alternatively 
can be piuchased from the Plaintiffs. (SMF 

T| 27.) But after Plaintiffs succeeded in 
convincing Public Resoiuce to take down the 
version of the 1999 Standards it had posted on 
the Internet (pending the outcome of this 
litigation). Plaintiffs proceeded to take the 

1999 Standards off sale — leaving citizens who 
needed access to the law to either track down a 
second-hand copy, or make a written 
appointment with the National Archives and 
travel to Washington D.C. {See SMF ^ 27, 39- 
43.) Althorrgh Plaintiffs pirt the 1999 

Starrdards orr sale once more after the issrre 
was raised at deposition. Plaintiffs assert that 
they expect to eventirally take the 1999 

Standards off sale at some imdefrned point in 
the ftrtme. ICE Ex. 5 (Levine Dep. 55:09- 
56:10). Moreover, the 1999 Standards are not 
reasonably available to individirals who are 
blind or visrrally disabled, and who carmot 
perceive paper copies of this docrrment. ICE 

Ex. 51 (Fnrchtennan Report) pp.5-6. Becairse 
sections of the 1999 Standards apply 
particrrlarly to fan testing of individirals with 
disabilities, it is especially important that these 
citizens have access to the 1999 Standards to 
ensine that the testing they encoimter is in 
compliance with the law. ICE Ex. 5 1 
(Fnrchtennan Report) p. 6. 

47. Thus, it is required that (i) a copy of the 
incoiporated material must be on file with the 
Office of the Federal Register and (ii) the 
regulations incoiporating such material must 
state the ways those incoiporated materials are 
reasonably available to interested parties. 

1 C.F.R. §§ 51.3, 51.5. There is no requuement 
that such materials be available to the public at 
no cost. 

Nonfactiral legal argirment; dispirted. The 
contoins of the reqirnement that materials 
incorporated by reference be “reasonably 
available to the class of persons affected” is a 
legal qirestion m dispirte and has not been 
defined by any comt. Plaintiffs’ assertion that 
“[tjhere is no reqirnement that [materials 
incorporated by reference into the law] be 
available to the public at no cost” is an 
enoneous legal conclusion - United States law 
must be free and available to citizens to read 
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and speak. See Public Resoiuce’s 

Memorandimi of Points and Authorities. 

48. Defendant Public Resoiuce is a California 
non-profit corporation founded in 2007 by 

Ml'. Carl Malamud (“Malamud”), with the aim 
of making govei'nment infoimation more 
accessible with particular emphasis on the law 
(Hridis Deck, Tf 2, Exh. A, pp. 77, 93-94, 163- 
164). 

Undisputed. 

49. The identified piupose and objective of 
Public Resoiuce is to create and maintam so- 
called infoi'mational “public works projects for 
the Intei'uet” (Hudis Deck, ^ 2, Exh. A, pp. 94- 
95, 105-109, t 3, Exh. B, Section ILB., ^ 4, 

Exh. C. Section 2.1). 

Undisputed. 

50. In actuality. Public Resoiuce maintains an 
assoi'tment of seemingly random websites, 
wliich contain materials ranging from teclmical 
projects in which Malamud has been involved, 
to his commentai'y on goveirmient databases 
and entities (e.g., PACER, EDGAR, the 
Government Printing Office and the 
Smithsonian), to myriad collections of 
legislative, regulatoi'y, and case law materials 
(Hudis Deck, 1 2, Exh. A, pp. 78-84, 96-102, 

1 1 1-1 13, t 5, Exh. D). 

Disputed. Plaintiffs’ derogatory 
characterization of Public Resoiuce is a non- 
factual opinion, and Plaintiffs’ coimsel 

Ml'. Hudis is not qualified as an expert to opine 
on this matter. Public Resoiuce’s website is 
sti'uctiued for navigation by sear ch engines and 
for bulk access. Data are organized by coimtr'y 
(e.g., /pub/us/) then by type of data, such as 
standards incorporated by reference 
(/pub/us/cfi'/ibr/). Malamud Deck 29. Tire 
Comt is invited to view Pirblic Resoiuce’s 
website at httns://law.resoiuce.ore. 

5 1 . Of pariicular interest for this litigation is 
Pirblic Resoiuce ’s website titled 
httDs;//law.resoiuce.ora. on which Public 
Resoiuce posted the infringing digital copy of 
the Sponsoring Organizations’ 1999 Standards 
(Hudis Deck, 2, Exh. A, pp. 83-88, 234). 

Noufactual legal argument and opinion; 
disputed to the extent that Plaintiffs assert 

Public Resoiuce posted an “infrmging digital 
copy of the Sponsoring Organizations’ 1999 
Standards.” Public Resoiuce posted a version 
of the 1999 Standards on its website, but there 
is a legal dispute as to whether the version the 
Public Resoiuce posted was iufringmg, as well 
as whether Plaintiffs own rights to the 1999 
Standards. Moreover, what Public Resoiuce 
posted was not a “copy” in the legal sense. As 
defined by the 1976 Copyright Act, ‘“copies’ 
are material objects, other than phonorecords. 
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in which a work is fixed by any method now 
known or later developed, and fiom which the 
work can be perceived, reproduced, or 
otherwise commimicated, either directly or 
with the aid of a machine or device.” 17 U.S.C. 
§101. The Copyright Act provides for 
exclusive rights that apply to “copies” (17 

U.S.C. § 106 (1) and (3)), as well as exclusive 
lights that do not implicate “copies” (17 

U.S.C. § 106 (2) and (4)-(6)). The electronic 
version of the 1999 Standards that Public 
Resomce posted was not a material object, and 
therefore not a “copy” imder the Copyright 

Act. 

52. Public Resomce does not provide any other 
sei'vices, and does not sell any products (Hudis 
Dec!., 1 2, Exh. A, pp. 102-103, 127). 

Undisputed. 

53. Malamiid has worked in the computer 
science, computer networks, and information 
technology fields since 1980. Although he has 
no fomial education on these subjects, 

Malamud has written many books and articles 
on, and taught classes in, these areas (Hudis 
Deck, 1 2, Exh. A, pp. 22-77, 6, Exh. E). 

Undisputed. 

54. On behalf of Public Resomce, Malamud 
spends his time operating its varied websites, 
giving speeches, sending letters and FOIA 
requests to government officials, and attending 
to the company’s finances (Hudis Deck, f 2, 

Exh. A, pp. 78-79, 88-90). 

Undisputed. 

55. While Public Resomce does have a Board 
of Directors to whom Malamud reports, the 
company has no other officers, employees or 
members (Hudis Deck, ^ 2, Exh. A, pp. 90, 
120-123, Exh. E). 

Undisputed. 
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56. In short, except for the retention of 
independent contractors here and there (Hudis 
Decl., ]1 2, Exh. A, pp. 135-136), Malamud is 
Public Resoiuce. 

Denied. Pirblic Resoiuce is a not-for-profit 
organization foimded by Mr'. Malamud, and 
operated luider the direction of a board of 
tnrstees that includes Tim Stanley, CEO of 
Justia and affiliate with the Stanford 

University Copyr'ight and Fair' Use Center, as 
well as Ed Walters, CEO of Fastcase and 
Adjimct Professor at the Georgetown 

University Law Center. See 

httns ;//Dublic .resoiuce . ore/ about/ mdex.htrnl 

57. Public Resoiuce obtains its fimding and/or 
outside legal assistance from a cadre of law 
frmrs, foimdations and Internet companies (e.g., 
Google and Creative Conuuons) (Hudis Decl., 

If 2, Exh. A, pp. 135-136, 1 5, Exh. D). 

Disputed to the extent that Plaintiffs 
characterize Public Resoiuce’s fimding and 
legal assistance as corning from a “cadre” of 
law firms, foimdations and Internet companies. 
A listing of donors who permit their' names to 
be publicly listed appears on Public Resoiuce ’s 
“About” page. 

httosV/mrblic.resoiuce.ora/about/mdex.html 

58. In 2013, Malarnud used a Kickstarter 
crowd-fimding campaign to raise between 
$100,000 and $1.2 million in order to finance 
Public Resoiuce’s infiiuguig operation of re- 
typing (or “double-keying”) third-party 
standards, and publishing them to the 
httns.V/law.resoiuce.ora website. However, this 
Kickstarter effort was imsuccessfirl (Hudis 

Deck, 1 2, Exh. A, pp. 82-83, 206-212, If 7, 

Exh. F). 

Irmuaterial. Disputed to the extent that 

Plaintiffs assert that Public Resomce’s 
activities are infringing, which is the subject of 
this litigation. Disputed also to the extent that 
Plaintiffs characterize Pirblic Resoiuce’s 
activities as “publishing,” as the term is not 
used according to the meaning in the 1976 
Copyriglit Act, which defines “publication” as 
“the distribution of copies or phonorecords of a 
work to the public by sale or other transfer of 
ownership, or by rental, lease, or lending. . . A 
public performance or display of a work does 
not itself constitirte publication.” 17 U.S.C. 

§ 101 (emphasis added). As defined by the 

1976 Copyright Act, ‘“copies’ are material 
objects, other than phonorecords, in which a 
work is fixed by any method now known or 
later developed, and from which the work can 
be perceived, reproduced, or otherwise 
cormnimicated, either directly or with the aid 
of a machine or device.” 17 U.S.C. § 101. The 
Copyright Act provides for exclusive rights 
that apply to “copies” (17 U.S.C. § 106 (1) and 
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(3) ), as well as exchrsive rights that do not 
implicate “copies” (17 U.S.C. § 106 (2) and 

(4) -(6)). The electrorric version of the 1999 
Starrdards that Prtblic Resoruce posted was not 
a material object, and therefore not a “copy” 
rmder the Copyright Act. 


59. In Malamud’s view, “standards” are a set of 
best practices that the organization publishing 
them believes should be widely adopted. An 
example given by Malamud are the best 
practice standards for computer networking 
promiilgated by the Internet Engineering Task 
Force (Hudis Deck, T[ 2, Exh. A, pp. 59-60). 

Public. Resoiuce.Org spent [fimds] ... 
buying privately-produced ... standards .... 
These ... standards govern and protect a 
wide range of activity .... We have started 
copying those ... standards despite the fact 
they are festooned with copyright warnings, 
shimkwrap agreements and other dire 
warnings. (Deleted material refening to 
“technical pitblic safety standards”). 

*** 

We know from all the copyright warnings, 
terms of use, scary slu ink wrap agr eements, 
and other red-hot rhetoric that accompanies 
these docrrrnents that the prodircers continire 
to believe that copies may not be made 
rmder any circirmstances. 

(Hrtdis Deck, 1 2, Exh. A, pp. 181-184, 1 9, 

Exh. H (Malamrtd, C., Liberating America’s 
Secret, For-Pay Laws, boirrgboing . 

March 19, 2012), prodrrction 

pp. AERA_APA_NCME_3 1764-3 1765). 


Disprrted. Plaintiffs provide no evidence for 
their claim as to what Mr'. Malamrrd considers 
a “standard” to be and it is not clear how they 
anive at sitch a character'ization. Tire cited 
deposition testimony simply describes 
Mr'. Malamird’s participation in the 
development of Internet Engineering Task 
Force standards, and does rrot describe how 
Mr'. Malamrrd defines a “standard” generally. 

Disprrted. Plaintiffs lack evidence for their 
assertions and mischaracterize Mr'. Malarnud’s 
statements in his 1993 book “Exploring the 
Internet: a Technical Travelogire.” This 
chapter, which is taken orrt of context, 
describes Mr'. Malamrrd’s work with the 
International Teleconrmimication Union 
(“ITU”) to convert ITU specifications to a 
digital for'mat and post them online, with the 
srrpport of the TTU (inchrding the blessing of 
the secretary general of the ITU, as described 
m the book). This project was called “Bnmo,” 
and in the chapter “Geneva” Mr'. Malamrrd 
uses the phrase “baby killer” as a joking way 
to refer to the organization’s decisions as to 
how it shoitld prioritize resoiuces (not a “code- 
name” for the project, as Plaintiffs assert). 

This chapter does not srrpport Plaintiffs’ 
accrrsation that Mr'. Malamrrd “knew that 
copying and widely dissenrinating standards, 
for free arrd withoirt per'mission . . . wortld 
adversely impact the revemres of the 
organizations that prrblished airthorized copies 
of those standards,” not least of which becarrse 
Mr'. Malamrrd had the per'mission of ITU for its 
activities, and also becarrse the chapter 
describes how Mr'. Malamrrd errdeavored to 
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convey to officials within the ITU that the 
digitization project would result in a net 
revenue benefit to the ITU. ICE Ex. 7 
(Malamud Dep. 159:14-21); Hudis Decl. Exh. 

G. The project was very successfiil and today 
the ITU makes all of its standards fieely 
available on the Inteiuet. Malamud Decl. ^ 5. 
Although Plaintiffs appear to have mistakenly 
cited paragraph nine of Mi'. Hudis ’s 
declaration, rather than paragraph eight. 
Plaintiffs lack evidentiary support for their 
eiToneous claims regardless of wliich 
paragraph is cited. 

Disputed. Plaintiffs lack evidence for their 
claims, as the cited text does not support the 
statement that Mi'. Malamud “clearly knew that 
the copying of others’ copyrighted standards to 
its website constituted copyiiglit 
infi'ingemeut.” In fact, the cited article says 
just the opposite, and Plaintiffs have quoted 
selectively, hr the second sentence after the 
quoted passage, Mr. Malamud states “. . . we 
strongly believe that the docimieuts are not 
entitled to copyright protection . . . .” Indeed, 
in the portion that Plaintiffs quote. 

Ml'. Malamud simply states that some 
standards include copyright notices; 

Ml'. Malamud does not state that these 
copyright claims are valid. Dkt. 60-11, Hudis 
Decl. Exh. H. Moreover, Plaintiffs’ statement 
includes a legal conclusion regarding a matter 
that is in dispute m this litigation: whether the 
posting of standards incorporated by reference 
into the law constihites copyright 
mfiingement. 

62. It is nonetheless Malamud’s imwaveiing 
belief that, once a govenunental entity 
incoiporates a standard by reference mto a 
stahite or a regulation, the standard becomes 
“the law” and as such loses its copyright 
protection (Hudis DecL, T[ 2, Exh. A, pp. 172- 
73,218-219, 257,358-61). 

Undisputed. 
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63. According to Malamud’s line of thinking, 
once standards lose their copyright protection in 
this manner, anyone can copy them, convert 
them to digital fonn, post them on the Internet 
and allow others to download or print them at 
will and for free (Hudis Deck, If 2, Exh. A, pp. 
187-88). 

Undisprrted. 

64. Malamud frnfher believes that it is perfectly 
acceptable for standards development 
organizations, such as Plaintiffs, to lose their 
copyright in standards incoiporated by 
reference - and with it the economic value that 
copyiight brings. According to Malamud, 
though knowing veiy little about the 

Sponsoiing Organizations’ operations, finances, 
policies or practices for updating then 

Standards (Hudis Dec., ^ 2, Exh. A, pp. 192-93, 
199-201, 223-232), in such circumstances 
Plaintiffs (and similarly situated standards 
development organizations) should simply 
change then business model(s) by finding other 
ways to finance updates to their Standards, or 
making the govenunent pay for the updates; 

BOB GARFIELD (Interviewer): There is 
an expense attached to developing and 
codifying these standards. If we take the 
revenue away from those who do this work, 
then what happens? 

CARL MALAMID: Well, there’s two 
answers to that. One is that the non-profits 
that develop these standards have a lot of 
different revenue streams. They do 
conferences, they do certification. They 
develop standards that aren’t law. ... And so, 
inoybe they need to adjust their business 
model, particularly given the fact they are a 
non-profrt prrblic charity. Answer nirmber 
two is that government has shirked its 
responsibilities. It said, gee, we can jrrst 
incorporate these privately developed 
standards in the law, and we won’t have to 
pay anything. And the only people that get 

Disprrted. Plaintiffs’ characterization is not 
sirpported by the qiroted text, and is 
controverted by Mr'. Malamrrd’s deposition 
testimony that Plaintiffs cite, in which 

Mr'. Malamird states that he disagrees with 
Plaintiffs’ coimseTs characterization and 
points orrt that even if the law is made fr eely 
available to the prrblic, it does not prechtde 
standards organizations from selling copies of 
those standards (parficirlarly arrthenticated 
copies, redlines, or versions with commentary 
or armotations). ICE Ex. 7 (Malamird Dep. 
177:20-178;14). Plaintiffs selective qirotation 
of the On the Media transcript omits a sentence 
(where Plaintiffs have inserfed an ellipses) in 
which Mr'. Malamud explains that the vast 
majority of standards that standard 
organizations publish are not law (meaning 
that the vast majority of revenues would be 
imaffected for these organizations). Plaintiffs 
also omit frulher explanation by Mr'. Malamud 
that there are many ancillary benefits to 
standards organizations and their members that 
come from having standards incorporated by 
reference into the law, which offset any 
hypothetical loss to income. Dkt 60-12, Hudis 
Deck Exh. 1. 
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screwed up by this are the citizens that need 
to read the law. 


(Hudis Decl., 1 2, Exh. A, pp. 173-180, 1 10, 

Exh. I (Garfield, B., Making Laws More Public 
Transcript - On The Media, intei'view of Carl 
Malamud, The Media. Aoril 13. 20121. 
production p. AERA_APA_NCME_32076) 
(emphasis added). 


65. In March 2012, Public Resoiuce began 
copying standards incoiporated by reference 
into the Code of Federal Regulations, and 
providing the copies of these standards to 
others. In May 2012, Public Resoiuce began the 
process of posting copies [ 57 c] these standards 
to its website. By May 2015, Public Resoiuce 
had posted PDF copies of over 1,000 standards 
to its website (Hudis Decl., ^ 2, Exh. A, 

pp. 216-218). 

Disputed to the extent that Plaintiffs 
mischaracterize Public Resoiuce’s activities. 

In March 2012, Public Resoiuce made 25 
photocopies of 73 public safety standards that 
had been incoiporated by reference into U.S. 
federal law and were sent to seven U.S. 
government offices (including the White 

House, Senate, House of Representatives, 
National Archives, Administrative Conference 
of the United States, Federal Trade 

Commission, and the Copyright Office), ten 
standards organizations, and to attorneys, 
joiuTialists, and Harvard Law School. The 

1999 Standards were not among this group of 
standards, nor were Plaintiffs recipients of 
these photocopies. See Plaintiffs’ Exh. H. In 
May 2012 Public Resoiuce began the process 
of posting electronic versions of standards 
incoiporated by reference on the Public 

Resoiuce website - not “copies,” which are 
defined as material objects imder the 1976 
Copyiiglit Act. See SMF H 38, 17 U.S.C. § 

101. 

66. To demonstiate the depth and breadth of 
Public Resoiuce’s activities. Defendant has 
published to its website https://law.resoiuce.org, 
inter alia, numerous state and municipal codes, 
public safety codes, and technical standards - 
see, e.g., 

httos://law.resource.org/pub us code safetv.html 

and 

https://law.resoiuce.ora/oub/us/cfi'/manifest.us. 

html (Hudis Decl., ^ 1 1-12, Exhs. J-K). 

Disputed to the extent that Plaintiffs assert 
Public Resoiuce has “published” docimients to 
its website, as the term is not used according to 
the meaning in the 1976 Copyright Act, which 
defines “publication” as “the distiibution of 
copies or phonorecords of a work to the public 
by sale or other transfer of ownership, or by 
rental, lease, or lending. . . A public 
perfoimance or display of a work does not 
itself constitute publication.” 17 U.S.C. § 101 
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(emphasis added). As defined by the 1976 
Copyiiglit Act, ‘“copies’ are material objects, 
other than phonorecords, in which a work is 
fixed by any method now known or later 
developed, and from which the work can be 
perceived, reproduced, or otheiwise 
communicated, either diiectly or with the aid 
of a machine or device.” 17 U.S.C. § 101. The 
Copyright Act provides for exclusive rights 
that apply to “copies” (17 U.S.C. § 106 (1) and 

(3) ), as well as exclusive rights that do not 
implicate “copies” (17 U.S.C. § 106 (2) and 

(4) -(6)). The electronic version of the 1999 
Standards that Public Resomce posted was not 
a material object, and therefore not a “copy” 
imder the Copyiight Act. Undisputed to the 
extent that Public Resomce has posted 
identified materials to its website. 

67. Several of the codes and standards that 

Public Resoiu'ce publishes on the 
httt)s://law.resomce.or 2 website are subiect to 
U.S. copyright protection (Hudis Decl., ITf 13- 
20, Exhs. L-S), and it is believed that Public 
Resomce publishes these codes and standards to 
the httDs://law.resource.ore website without 
obtaining the pennission of the copyiight 
owtiers of these works - for example: the Safety 
Standard for Belt Manlifts: ASME A90. 1-2003; 
the Guidelines for the definition of onshore gas 
gathering lines, the Classification in Mental 
Retardation (1983 revision), the Official 
methods of analysis of the Association of 

Official Analytical Chemists, the Glazing 

Manual (1990 edition). Mobile and Locomotive 
Cranes: ASME B30. 5-2004, Drinking water 
system components: health effects: American 
national staudard/NSF international standard for 
diiukiug water additives : ANSI/INSF 61-2001, 
and the Minimum design loads for buildings 
and other stnictmes (Special ed. 2003). 

Nonfactual legal argument; disputed. The 
question of whether standards incorporated by 
reference into law are “subject to U.S. 
copyright protection” is a legal issue in dispute 
in this litigation. Additionally, Plaintiffs have 
not provided admissible evidence to support 
their assertion that copyrights for these 
standards aie owned by the thud paify 
organizations as Plaintiffs claim, as online 
abstracts of copyiight registiations are not 
official registrations, nor aie they proof of 
copyright ownership, and Plaintiffs have not 
obtained any statements fr om these thir d party 
organizations to that effect. 
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68. In early 2012, Malamud was pemsing 
thr ough the Code of Federal Regulations, 
looking for various standards pmpoifedly 
incorporated by reference therein, when he 
came irpon a reference to the Sponsoring 
Organizations’ 1999 Standards (Hrrdis Deck, 

1 2, Exh. A, pp. 232- 233). 

Irmnateriak disputed. In the cited deposition 
testimony, Mr-. Malamud states that the 1999 
Standards came to Iris attention becairse they 
were specified as having been incorporated by 
reference imder the Code of Federal 

Regulations. Mr'. Malamird does not say that 
he was “penrsing thr oirgh the Code of Federal 
Regulations, looking for various standards 
pmportedly incorporated by reference therein, 
when he came upon a reference to the . . . 1999 
Standards.” ICE Ex. 7 (Malamud Dep. 232:09- 
25). 

69. On May 17, 2012, Public Resoruce 
piu chased a used copy of the 1999 Standards 
from an Amazon re-seller, “The Book Grove” 
(Hudis Deck, 1 2, Exh. A, pp. 232-240, 121, 

Exh. T, Int. Ans. 1, H 22-23, Exhs. U and V). 

Undisputed. 

70. Public Resomce only paid for the 1999 
Standards, however, after a failed attempt in 

2009 of prociuing them for free (or at least at a 
reduced cost) from the National Archives 
piu suaut to a Freedom of Information Act 
reqirest and accompanying “fee waiver” (Hudis 
Deck, 1 2, Exh. A, pp. 240-51, 1 24, Exh. W 
(production pp. AERA APA NCME 10153- 
57 and 10167) and 1 25, Exh. X). 

Irmnateriak dispirted to the extent that 

Plaintiffs characterize Public Resource’s 2009 
Freedom of Information Act (“FOIA”) request 
as an attempt to procme the 1999 Standards for 
free. Mr'. Malamud stated at deposition that he 
was not cerfaru if there woirld have been a 
charge to Pirblic Resomce by the National 
Archives and Records Administr ation for 
making the infor'uiatiorr it reqirested available. 
Tliis FOIA reqirest was for approximately 

2,000 standards that have been incorporated by 
reference into law, of which the 1999 

Standards were one of the listed standards. 
Public Resomce requested a fee waiver, and in 
the alternative, requested that if no fees were 
waived, the National Archives should provide 
a partial response up to $5,000 of char ges 
(which may or may not have included the 1999 
Standards). Dkt. 60-27, Hudis Deck Exh. W. 
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7 1 . Upon receipt of the piu chased paper copy of 
the 1999 Standards, Malamiid disassembled the 
book, removed the spine, tiimmed the pages to 
give them an even border, scanned the pages to 
create a PDF (Acrobat Reader) file using a 
Xerox scanner, and named the PDF file “aera. 
standards.l999.pdf.” Malamud then appended a 
cover sheet, or self-made “Certificate,” to the 
fiont of the PDF file giving a false semblance of 
govenmiental approval or peimission to the 
imauthorized copying and online posting of the 
1999 Standards (Hudis Deck, ^ 2, Exh. A, 
pp. 257-259, 261-264, 121, Exh. T, Int. Anss. 
3-4, 1 26, Exh. Y); 


Defendant Public Resource’s Response 

Disputed to the extent that Plaintiffs assert that 
Public Resomce’s cover sheets “giv[e] a false 
semblance of govenmiental approval or 
peimission to the imauthorized copying and 
online posting of the 1999 Standards.” 
Plaintiffs have failed to adduce admissible 
evidence in support of this alleged “fact,” and 
this is opinion, not fact. Plaintiffs’ coimsel 
Ml'. Hudis is not qualified as an expert to opine 
on this matter. 




72. Next, Malamud cloitus he post-processed 
Public Resoiu'ce’s PDF file of the scanned 1999 
Standards to generate Optical Character 
Recognition (“OCR”) on the text (Hudis Deck, 
1 2, Exh. A, p. 260, 121, Exh. T, Int. 

Anss. 3-4). 


Undisputed. 
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73. However, according to Public Resomce’s 
expert, James Fnichtennan, Malamud never 
OCR-processed the PDF file, so all Malamud 
and Public Resomce posted to the Internet was 
an image-otily document (Hudis Decl., f 27, 

Exh. Z, pp. 309-310, ][ 28, Exh. AA, p. 9 (and 
sub-Exh. B thereto)). 

Disputed. Public Resomce posted two versions 
of the 1999 Standards online: one version on 
the Public Resomce website, and the other on 
the Internet Archive website. The version 
posted on the Internet Archive website did 
imdergo OCR and was available in varioirs text 
formats that were unmediately accessible to 
people who are blind or visirally impaired 
thr ougli irse of screen reading programs. ICE 

Ex. 51 (Frnchterman Report) p. 11-12. 

74. OCR is the process of having a machine 
recognize letters and words, generally from 
docimients, and translate those into letter or 
word equivalents (Hudis Decl., f 27, Exh. Z, 
pp. 29-30). 

Undispirted. 

75. Without OCR-processmg, Public 

Resomce’s imauthorized copying and posting of 
the 1999 Standards provided no additional 
technical value, such as for word-searching, 
onlme identification, or text-to-speech 
utilization for the blind and visually impaued 
(Hudis Decl., t 27, Exh. Z, pp. 30, 122, 200-01, 
206, 271-72,315-16). 

Disprrted. Plaintiffs have failed to addrrce 
admissible evidence m sirpport of this alleged 
“fact,” and this is opinion, not fact. Plamtiffs’ 
coimsel Mr'. Hirdis is not qrralifred as an expert 
to opine on this matter. 

Pirblic Resomce posted two versions of the 

1999 Standards online: one version on the 

Prtblic Resomce website, and the other on the 
Internet Archive website. The version posted 
on the Internet Archive website did imdergo 
OCR and was available m various text formats 
that were immediately accessible to people 
who are blind or visually impaued through use 
of screen reading progr ams. ICE Ex. 51 
(Frnchterman Report) p. 11-12. The electronic 
version of the 1999 Standards that Public 
Resomce posted on the Public Resomce 
website that did not imdergo OCR is still 
valuable to people who are blmd or visually 
disabled because it is relatively trivial for such 
a person to perform OCR on the docimient. 

What is not trivial for a person who is blind or 
visually disabled is to obtain a paper copy of 
the 1999 Standards, scan each page, and 
produce an electronic version that can then 
have OCR performed on it, as this reqiiues 
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equipment that most people who are blind do 
not own, and takes horn s of work. The non- 
OCR version that Riblic Resoiuce posted on 
the Riblic Resoiuce website is therefore a 
valuable contribution to making the 1999 
Standards available to people who are blind or 
visually disabled. ICE Ex. 5 1 (Fmchteiman 
Report) p. 8-9. 

76. In the final step of the process, Malamud 
claims he stamped metadata into the headers of 
the PDF file, posted the file (the enthety of 
Plaintiffs’ 1999 Standards) to Public Resource’s 
httDs://law.resoiuce.ora website as well as the 
website of the Internet Archive 
('httus://archive.ors) CAnswer & Coimterclaim, 
Coiut Dkt. 12, 7, 55; Hitdis Dec!., f 2, 

Exh. A, pp. 233-34, 271-72; 12 1, Exlr. T, hit. 
Ans. No. 2). 

Undisputed. 

77. In Defendant’s intenogatoiy answers 
(verified by Malamud), Riblic Resource 
describes a detailed quality control process 
attendant to the imlawflil digital copying of the 
Sponsoring Organizations’ 1999 Standards. 
Dining deposition questioning, however, 
Malamud was imsure whether he followed 
those quality control procediues at all (Hudis 
Decl., 1 2, Exh. A, pp. 260-61, 267-68, 274- 
275, 121, Exh. T, hit. Anss. 3-4, 1 35, 

Exh. HH, Admission No. 2). 

Disputed. Plaintiffs have not provided 
evidence to support this assertion. At 
deposition. Plaintiffs’ coimsel asked if 

Mr'. Malamud had checked the quality of the 
OCR process for acciuacy for the 1999 
Standards, and Mr'. Malamud responded that 
he did not, because that was not a part of 

Rrblic Resoiuce ’s normal workflow. ICE Ex. 7 
(Malamud Dep. 267:06-268:02). 

78. The hitemet Archive is a nonprofit 
organization whose mission is to build and 
maintain a digital library of the hitemet. The 
Internet Archive builds this hitemet library - 
which it makes available for public use - by 
scanning, digitally caphuing, and saving the 
electronically scaimed and captiued thud-party 
websites, and by receiving content submissions 
from thud parties who have access to do so by 
the establishment of user accoimts (Hudis Deck, 
129, Exh. BB,pp. 31-41). 

Undisputed. 
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79. Malamud has such user account access 
(Hudis Decl., ^ 29, Exh. BB, pp. 51-56), 
thr ough which he uploaded the entir ety of the 
1999 Standards to the Internet Archive’s 
website on May 26-27, 2012 (Hudis Decl., f 29, 
Exh. BB, pp. 59-1 12, 1 30, Exh. CC 3-18 
therein), ^ 32, Exh. EE, ^ 33, Exh. FF). 

Undisputed. 

80. Public Resoiuce posted Plaintiffs’ 1999 
Standards to its website and the Internet 

Archive website without the permission or 
airthorization of any of the Sponsoring 
Organizations (Hirdis Decl., ^ 35, Exh. HH, 
Admission Nos. 4-5; Levine Decl., ^ 29; 

Ernesto Decl., f 35; Wise Decl., ^ 26). 

Undisputed. 

81. By irploading the 1999 Standards to the 
Internet Archive, Public Resoiuce violated the 
Internet Archive’s Terms of Use in effect at the 
time of Public Resoiuce ’s infr ingement, which 
in relevant part states; 

This terms of use agr eement (the 
“Agr eement”) governs yoiu use of the 
collection of Web pages and other digital 
content (the “Collections”) available 
through the Internet Archive (the 
“Archive”). When accessing an archived 
page, you will be presented with the terms 
of use agr eement. If you do not agree to 
these terms, please do not use the Archive’s 
Collections or its Web site (the “Site”). 

* * * 

Some of the content available thr ough the 
Archive may be governed by local, national, 
and/or international laws and regulations ... 
You agree to abide by all applicable laws 
and regulations, including intellectual 
properly laws, in cormection with yoiu use 
of the Archive. In particular, you certify that 
your use of auy part of the Archive ’s 
CoUectious will be ... lituited to 
uouiufriugiug or fair use uuder copyright 
law. In using the Archive’s site. Collections, 

Denied. This is a legal opinion, not a fact. 

Tire legal question of whether posting 
standards that have been incorporated by 
reference into the law is noninfringing or fan 
use is at issue in this litigation. 
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and/or sei'vices, you ftullier agree ...(b) not 
to act in any way that might give rise to civil 
or criminal liability, [and] ...(e) not to 
infringe any copyright, trademark, patent, 
or other proprietary rights of any person , ... 

(Hudis Decl., 1 29, Exh. BB, pp. 41-45, J3l, 
Exh. DD) (emphasis added). 

82. The imauthoiized copy of the Sponsoring 
Organizations’ 1999 Standards that Malamud 
published to the Internet Archive at 
https : // archive, or g/ details/ gov, law, aera . standard 

S.1999 was in the exact same fonnat, using the 
same cover sheet or “Certificate” employed by 
Public Resoiu ce m the posting of the 
Sponsoring Organizations’ 1999 Standards to 
Defendant’s own website. All of the 
siuToimdiug text associated with the postirrg to 
the hrteniet Archive website was inserted by 
Malarnitd - mchrdmg the msertiou of “Creative 
Co mm ons Licerrse; CCO 1 .0 Universal .” 
indicating that no rights are being asserted over 
the item (Hitdis Decl., f 2, Exh. A, pp. 275-284, 
1 29, Exh. BB, pp. 57-63, ^ 30, Exh. CC (1 2 
therein), Tf 34, Exh. GG): 


8r 


Defendant Public Resource’s Response 


Noufactiral legal argirment m part. Dispirted to 
the extent that the version of the 1999 
Standards that Public Resoiuce posted to the 
Internet Archive imderwent additional 
processing by the Internet Archive systems, 
perfonning OCR and creating a variety of 
different electronic formats that are thereby 
more accessible to people who are blind or 
visually disabled, and therefore not “the exact 
same format” as the version on the Pirblic 
Resoiuce website, as Plaintiffs suggest. ICE 
Ex. 51 (Fnichterman Report) p. 11-12. 
Disputed also to the extent that Plaintiffs assert 
that Public Resoiuce has “published” the 1999 
Standards to the hitemet Archive website, as 
the term is not used according to the meaning 
in the 1976 Copyright Act, which defines 
“publication” as “the distr ibution of copies or 
phonorecords of a work to the public by sale or 
other transfer of ownership, or by rental, lease, 
or lending. . . A public performance or display 
of a work does not itself constitirte 
publication.” 17U.S.C. § 101 (emphasis 
added). As defined by the 1976 Copyright 
Act, ‘“copies’ are material objects, other than 
phonorecords, in which a work is fixed by any 
method now known or later developed, and 
from which the work can be perceived, 
reproduced, or otherwise communicated, either 
dir ectly or with the aid of a machuie or 
device.” 17U.S.C. § 101. The Copyright Act 
provides for exclusive rights that apply to 
“copies” (17 U.S.C. § 106 (1) and (3)), as well 
as exclusive rights that do not implicate 
“copies” (17 U.S.C. § 106 (2) and (4)-(6)). 
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Tire electronic version of the 1999 Standards 
that Public Resoiuce posted was not a material 
object, and therefore not a “copy” imder the 
Copyiiglrt Act. 

83. Public Resoiuce claims the Sponsoring 
Organizations’ 1999 Standards were posted to 
Public Resoiuce’s httnsV/law.resoiuce.ora 
website and to the Internet Archive 
https; //archive. or g website from Jitlv 11, 2012 
to Jime 10, 2014 (Hirdis Decl., 1 21, Ex. T, Int. 
Arrs. 2). 

Undisputed. 

84. As previoirsly noted, Pitblic Resomce 
actirally itploaded the 1999 Standards to 

Internet Archive’s website on May 26-27, 2012. 
The Sponsoring Organizations have no ability 
to verify when Pirblic Resoiuce uploaded the 

1999 Standards to its own website, because 
neither the “file creation date” nor user access 
logs were produced diuing discovery, 
notwithstanding prodirction requests for this 
docimientation and an accompanying discovery 
motion demanding production that in relevant 
part was denied (Hirdis Decl., f 36). 

Disputed. Plaintiffs have not adduced 
admissible evidence to support this fact. 

Pirblic Resoiuce produced the version of the 
1999 Standards that it had posted on the Public 
Resoiuce website, complete with the file 
creation date in its metadata. As Mr'. Malamud 
stated at deposition, Pirblic Resoiuce does not 
have logs documenting the date on which the 
1999 Standards were posted to the Public 
Resoiuce website. ICE Ex. 7 (Malamud Dep. 
273:20-274:03). 

85. Although based on incomplete reporting 
because Public Resoiu ce destr oyed some of its 
records (Hirdis Decl., ^ 2, Exh. A, pp. 272-74, 
328-336), diuing the near two year period that 
the Sponsoring Organizations’ 1999 Standards 
were posted on Public Resoiuce’s 
httDs;//law.resoiuce.org website, thev were 
accessed at least 4,164 times (Hirdis Decl., 

^21, Exh. T, hit. Ans. 2 and Amended Ans. 5 
(labeled 6)). 

Disputed. Plaintiffs’ accusation that Public 
Resoiuce destroyed some of its records is 
imfoimded, and Plamtiffs fail to adduce 
evidence to support then claim. In the cited 
deposition testimony, Mr'. Malamud stated that 
when Public Resoiuce agreed to take the 1999 
Standards offline pending the outcome of tliis 
litigation, the act of taking the standards 
offline changed metadata on one of the files 
that might otherwise have been used to 
deter'urine the origmal posting date. Plaintiffs 
also cite Public Resoiuce ’s statement at 
deposition that Public Resoiuce previously had 
a 2-week retention policy for ser'ver logs imtil 
litigation commenced in the ASTM v. 

Public. Resoiuce. Org case in August 2013, at 
which time the server logs have been retained 
permanently (nine months prior to when the 
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AERA Plaintiffs filed suit). Plaintiffs’ claims 
as to the number of accesses of the 1999 
Standards on the Pirblic Resomce website is 
also inconect, as then' calculation appears to 
include access figmes for a stub page that 
replaced the 1999 Standards on the Public 
Resomce website in Time 2014, when Public 
Resomce had taken down the 1999 Standards 
pending the resolution of this litigation. See 

Dkt. 60-23, Hudis Decl. Exh. T. Plaintiffs also 
fail to explain that the nmnber of “accesses” 
means the number of access requests fi'om a 
computer to the Public Resomce ser'ver, and 
does not necessarily mean accesses by human 
beings, but could instead be accesses by 
webcrawlers, bots, or other automated 
programs. Dkt. 60-23, Hudis Decl. Exlr. T, at 
7-8. 

86. Dining that same period, the Sponsoring 
Organizations’ 1999 Standards were accessed 
on the Internet Archive httDs://archive.or 2 
website 1,290 times (Hudis Decl., ^ 29, 

Exh. BB, pp. 124-132, t 37, Exli. II). 

Disputed to the extent that the time period 
pertinent to the access figmes that Plamtiffs 
cite as Exh. n is not established in the 
documents Plaintiffs cite. Plaintiffs also fail to 
explain that the nimrber of “accesses” means 
the number of access requests fr om a computer 
to the Pirblic Resomce server, and does not 
necessarily mean accesses by human beings, 
but could instead be accesses by webcrawlers, 
bots, or other automated programs. Dkt. 60- 
23, Hudis Decl. Exh. T, at 7-8. 

87. The Internet Archive’s website is open to 
the public and does not restrict an Internet 
irser’s ability to download or print the 

Sponsoring Organizations’ 1999 Standards. 
Public Resomce also placed no such restrictions 
on its website (Hudis Decl., f 2, Exh. A, pp. 
347-48), as Defendant’s expert, 

Mr'. Frnchterman, confirmed (Hudis Decl., ^ 27, 
Exh. Z, pp. 327-28). 

Undisputed. 

88. Mr'. Frnchterman also confirmed that there 
were no sign-up procediues to enter Public 
Resoiu'ce’s httnsV/law.resomce.ora website, nor 

Disputed to the extent that Plaintiffs imply that 
DRM teclmology should be used to restr ict 
access to the law. 
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was there any Digital Rights Management (or 
“DRM”) plan to protect against wide-spread 
copyuig of the files accessed from Public 
Resoiuce’s site (Hudis Dec!., f 27, Exh. Z, pp. 
324-27, 167-173). 


89. The parties and the Comt can only speculate 
on the niunber of frufher electronic copies of 
the 1999 Standards that were made and 
distributed to others by the original Internet 
users who accessed the imauthorized copies that 
Public Resoiuce posted to its site and the 

Internet Archive site. 

Undisputed that the Plaintiffs’ statement 
indicates a lack of any evidence about the 
making or distribution of copies by any 
persons. Nonfactual statement. Otherwise 
disputed. Plaintiffs have not adduced 
admissible evidence to support this contention. 
This is opinion, not a fact, and Plaintiffs do not 
cite any evidence or individual who holds this 
opinion. Plaintiffs have the biuden of proof 
for establishuig haiin, and should not invite the 
Coiuf to “speculate” as to downstream copying 
or distribution of which Plaintiffs have failed 
to find any evidence. Notably, after Public 
Resoiuce took down the 1999 Standards 
pending the outcome of this litigation, 

Mr. Fnichtennan looked for an electronic 
version of the 1999 Standards online and could 
not find one. ICE Ex. 5 1 (Fnichtennan Expert 
Report), p. 5-6. 

90. There simply is no way for Plaintiffs to 
calculate with any degree of certainty the 
number of imiversity/college professors, 
students, testing companies and others who 
would have piuchased Plaintiffs’ Standards but 
for then wholesale posting on Defendant’s 
httus;//law.resoince.ora website and the Internet 
Aichive httn: //archive. ore website. fLevine 

Decl., ^ 30; Geisinger Dec!., Tf 24). 

Undisputed that there is no evidence of any 
lost sales of the 1999 Standards as a 
consequence of Defendant’s postmgs of the 

1999 Standards. Otherwise disputed. 

Plaintiffs have not adduced admissible 
evidence to support this contention. This is 
opuiion, not a fact. Dr. Levine is not qualified 
as an expert, and Dr. Geisinger is not qualified 
as an expert on the subject of economic 
substitution. See Riblic Resoiuce’s Motion to 
Strike the Declaration of Dr. Geisinger, Dkt. 

67. Plaintiffs have the biuden of proof for 
establishing harm, caimot shiarg off this biuden 
after failmg to find evidence of any individual 
who would have piuchased the 1999 Standards 
but for Riblic Resoiuce’s posting, and 
similaiiy failing to retain an expert witness 
with expertise in economic substitution. 
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91. In late 2013 and early 2014, the Sponsoring 
Organizations became aware that the 1999 
Standards had been posted on the Internet 
without then authorization, and that shidents 
were obtaining free copies from the posting 
soince. Upon fruther investigation, the 
Sponsoring Organizations discovered that 

Public Resoince was the soince of the onlme 
posting (Camara Decl., H 21, Exh. MMM; Wise 
Decl., 27-28, Exh. ELL). 

Disputed. Plaintiffs have not adduced 
admissible evidence to support then contention 
that students obtained fr ee copies of the 1999 
Standards from Public Resoince. 

92. In December 2013, Plaintiff AERA 
requested in writing that Public Resoince 
remove the 1999 Standards from its online 
postings (Levine Decl., ^ 31, Exh. UUU). 
Defendant flatly refrised (Hudis Decl., ^ 2, 

Exh. A, pp. 3 10-19, f 38, Exh. JJ, ^ 39, 

Exh. KK). Once this lawsuit was filed and the 
Sponsoiing Organizations threatened to file a 
motion for a preliminaiy injimction. Public 
Resoince agr eed in Jime 2014 to remove its 
postings of the 1999 Standards fr om its 
httDs;//law.resoince.ors website and from 

Internet Archive’s httr)s://archive.ora website - 
peudmg a resolution of this litigation on the 
merits. Public Resoince’s imdeifakiug included 
the promise not to post any revision of the 1999 
Standards (i.e., the 2014 Standards) pending the 
outcome of this litigation (Hudis Decl., ^ 2, 

Exh. A, pp. 322-28, ^ 40, Exh. LL, f 41, 

Exh. MM). 

Undisputed. 

93. Had Public Resoince not made, and 
followed through with, these promises, the 
Sponsoring Organizations would have filed a 
preliminary injimction motion and were 
seriously contemplating delaying publication of 
the 2014 Standards (Levine Decl., ^ 32). 

Undisputed. 

94. By Jime 2014, when Public Resoince finally 
removed its online postmgs of the 1999 
Standards, the damage aheady had been done. 

In Fiscal Year (“FY”) 201 1 to FY 2012, as 
compared to FY 2011, the Sponsoring 

Disputed. There was not a 34% drop in sales 
m in FY 2012 compared to the prior year. 

What Plaintiffs present as “sales” data is 
actually gross revenue data, not the number of 
sold. 
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Organizations experienced a 34% drop in sales 
of the 1999 Standards. In FY 2013, sales of the 
1999 Standards remained at then low level from 
the prior fiscal year (Levme Decl., Tn| 18, 33, 
Exh. OOO). 



Disputed also regarding Plaintiffs’ 
cnaracterization that “when Public Resoince 
finally removed its online postings of the 1999 
Standards, the damage a heady had been done.’ 
Plaintiffs fail to explain! 



Plaintiffs have not demonstrated any 
relationship between Public Resoince ’s 
posting and the sale of the 1 999 Standards. 
ICE Exs. 39, 41. Moreover, 



is consistent with Plamtiffs’ expert 
Dr. Geisinger’s prediction that if sales of the 
1999 Standards were affected by widespread 
knowledge that the new edition of the 
Standards were forthcoming, he expected that 
the decline would start in 2010 or 201 1. Dkt. 
60-88 (Geisinger Decl.) ^ 25; ICE Ex. 8 
(Geisinger Dep. 93:20-97:04). 


95. The timing of the drop in sales is notable, 
given that Public Resoince posted the Standards 
to the Internet in 2012-2013, and that the 
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Sponsoring Organizations’ updated Standards 
were not published imtil the summer of 2014 
(Levine DecL, ^ 34). 


Defendant Public Resource’s Response 



with Plaintiffs’ expert Dr. Geisinger’s 
prediction that if sales of the 1999 Standards 
were affected by widespread knowledge that 
the new edition of the Standards were 
foithcoming, he expected that the decline 
would start in 2010 or 2011. Dkt. 60-88 
(Geisinger Deck) 25; ICE Ex. 8 (Geisinger 
Dep. 93:20-97:04). 


96. For a publication with the longevity of the 
1999 Standards, one otheiwise would expect to 
see a gradual decline in sales year-over-year; 
not the precipitous drop m sales experienced by 
the 1999 Standards in 2012 and 2013 (Geisinger 
Dec!., 125). 


Disputed. This is not a fact, it is an opinion, 
and Dr. Geisinger is not qualified as an expert 
in the sirbject of economic srrbstitrrtion. See 
Pirblic Resoiuce’s Motion to Strike the 
Declaration of Dr. Geisinger, Dkt. 67. There 
was not a “precipitoirs drop m sales 
expe rienced by the 1999 Standards in 2012 and 
20i: 
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97. Past hann from Public Resomce’s 
infiinging activities includes misuse of 
Plaintiffs’ intellectual propeity without 
permission (Ernesto DecL, 36; Geisinger 
Decl., H 26), lost sales that cannot be totally 
accoimted for - due to potentially infinite 
Internet distribution, for example by 
psychometrics students (Wise Decl., ^ 27-28, 
Exh. ELL; Levine Decl., 1 35; Geisinger Decl., 
126). 


Defendant Public Resource’s Response 



consistent with Plaintiffs’ expert 


Dr. Geisinger’s prediction that if sales of the 
1999 Standards were affected by widespread 
knowledge that the new edition of the 
Standards were forthcoming, he expected that 
the decline woirld start irr 2010 or 2011. Dkt. 



Disprrted. Plaintiffs have failed to addrrce 
admissible evidence in sirpport of these alleged 
“facts.” Plaintiffs have not articirlated how the 
irse of standards incorporated into the law that 
Plaintiffs volimtarily took off sale coirld 
constitirte “harm” to Plaintiffs, short of 
conchrsory statements by Ms. Ernesto and 
Dr. Geisinger, neither of which ar e qrralified as 
experts on the srrbject of harm. See Prrblic 
Resoirrce’s Motion to Strike the Declaration of 
Dr. Geisinger, Dkt. 67. The qirestion of 
whether such irse is “nrisrrse” is legal issrre irr 
dispirte in this litigation. Plaintiffs have failed 
to addrrce admissible evidence to sirpport their 
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claim that there are any lost sales attributable 
to Public Resomce’s posting, nor that any such 
lost sales caimot be totally accoimted for, nor 
their speculation on “potentially i n finite 
Internet distribution.” Neither Dr. Wise nor 
Dr. Geisinger are qualified as experts on the 
subject of economic substitution or Internet 
distribution. See Public Resomce’s Motion to 
Strike the Declaration of Dr. Geisinger, Dkt. 


67. 


98. The harm also includes lack of fimdiug that 
otherwise woirld have been available for the 
update of the Sponsoring Organizations’ 
Standards from the 1999 to the 2014 versions 
(Levine Deck, If 35; Camara Deck, 1 22; 
Geisinger Deck, ^ 26). 


Disprrted. Plaintiffs have failed to adduce 
admissible evidence irr support of this alleged 



Therefore, 

Plaintiffs had many times th^ amoimt of 
frmdirrg necessary for the development of the 
2014 Standards, and the Test Starrdards 
Development Fimd is over twelve times as 
large as it was shortly after the pirblishing of 
the 1999 Standards. 


99. Should Pirblic Resoiuce’s infringement be 
allowed to continire, the harm to the Sponsoring 
Organizatioirs, arrd public at large who rely on 


Disprrted. Plaintiffs have failed to addirce 
admissible evidence irr sirpport of these alleged 
“facts.” These are opirrions, not facts, and 
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the preparation and administration of valid, fair 
and reliable tests, includes: (i) uncontrolled 
publication of the 1999 Standar ds without any 
notice that those guidelines have been replaced 
by the 2014 Standards; (ii) firtiue imquantifiable 
loss of revenue from sales of authorized copies 
of the 1999 Standards (with proper notice that 
they are no longer the ciuient version) and the 
2014 Standards; and (iii) lack of frmding for 
fritiue revisions of the 2014 Standards and 
beyond (Levine Decl., Tf 36; Camara DecL, 

If 23; Ernesto Decl., ^ 37; Geisinger Decl., 

If 27). 

Dr. Levine, Mr'. Camara, Ms. Er'nesto, and 

Dr. Geisinger are not qualified as experts on 
the subjects of economic substitirtion or harm. 
See Pirblic Resoiuce’s Motion to Strike the 
Declaration of Dr. Geisinger, Dkt. 67. 

100. Without the sales revenue from prior 
Standards versions (because - if Public 

Resource succeeds in this litigation - this 
publication will be made freely available 
online), it is very unlikely that fritme updates to 
the Standards will be imdeifaken. This is 
because NCME is too small an organization to 
financially support periodic irpdates of the 
Standards, AERA does not have the birdget for 
it, and an msirfficierrt nirmber of 
psychometricians are members of APA for it to 
justify the ongoing expenditiues. Charging 
extra membership fees to frmd ongoing irpdates 
to the Standards woirld never happen, because 
the governing bodies of AERA, APA and 

NCME would not vote for it. If these 

Sponsoring Organizations ceased updating the 
Standards, it is unlikely that other organizations 
would step in and continue the effort (Geisinger 
Decl., If 23). 

Disputed. Plaintiffs have failed to adduce 
admissible evidence m support of this alleged 
“fact.” These are opinions, not facts, and 

Dr. Geisinger is not qualified as experts on the 
subjects of economic substitirtion or harm. See 
Pirblic Resoiuce’s Motion to Strike the 
Declaration of Dr. Geisinger, Dkt. 67. 

Plaintiffs assume, contrary to evidence, that 
availability of the 1999 Standards on the 

Inter'net will mean that no copies of the 1999 
Standards will be sold, when sales continued 
even when Pirblic Resoiuce had posted the 

1999 Standards online. See, e.g., ICE Ex. 41. 
Moreover, Plaintiffs have no basis for claimmg 
that the organizations carmot frmd the^^H 
per-rnember aruiual cost of financing the 
development of the Standards, as described in 

1 39, above. 

101. The harm cairsed to the public by out-of- 
date Standards will be significant, because the 
testing and assessment fields are constantly 
changing, given irpdates in testing technology 
and ever-evolving collective thought on the 
validity, reliability and fairness of tests. 

Members of the public who would be harmed 
by discontinued update of the Standards mchrde 

Disputed. Plaintiffs have failed to adduce 
admissible evidence m support of this alleged 
“fact.” This statement is conchrsor'y as to harm, 
which has not been proven, and Plaintiffs have 
no evidence that people will be confirsed in 
relying on outdated standard as if it were the 
most recent edition. Moreover, Plaintiffs’ 
expertDr^eismgerstatedatdepositiou^^H 

psychometr ics professors, stirdents and 
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professionals, as well as test developers, 
administrators and test takers (Geisinger Deck, 
K28). 


102. Notwithstanding the harm it has caused, 
and could potentially continue to cause, Public 
Resource’s intentions are crystal clear'. 

Althoirgh not now pirblicly available pending 
the oirtcome of tlris litigatioir, Prtblic Resomce 
still has an imauthorized copy of the Sponsoring 
Organizatioirs’ 1999 Starrdards orr its server 
(Hudis Deck, ^ 2, Exh. A, pp. 273, 309); as 
does the Internet Archive (Hudis Deck, T| 29, 

Exh. BB,pp. 116-17). 

Disputed that Public Resomce has caused any 
harm. Public Resource does not dispute that it 
has a version of the 1999 Standards on its 
server. Disputed as to whether Public 

Resomce’s copy is “rmarithorized” because 
that is a legal conclusion and Public Resource 
does not accept that Plaintiffs have any right to 
authorize or dearithorize copies of the law. 
Undisputed that Public Resomce’s intentions 
of making the law available to and accessible 
by the public is crystal clear. 

103. It woirld be very simple for Prtblic 

Resource to re-post the 1999 Standards to 

Prtblic Resomce ’s website with little effort 
(Hrtdis Deck, 1 2, Exh. A, pp. 306-07). 

Undisputed. 

104. Moreover, shortld Public Resomce 
srrccessfrrlly defend this lawsrrit, it has every 
inteutiorr of similarly posting the Sponsoring 
Organizatioirs’ 2014 Standards to the luteiiret in 
the same manner it posted Plaintiffs’ 1999 
Standards (Hrtdis Deck, ^ 2, Exh. A, 
pp. 308-09). 

Disputed. Public Resomce has never posted 
the 2014 edition of the Standards anywhere, 
and Public Resomce has never stated an 
urtention to post the 2014 Standards. To Prrblic 
Resomce’s krrowledge, the 2014 Standards 
have not been incorporated by reference into 
law. Malamrrd Deck ^ 33. It is rmdisprrted that 
Prtblic Resomce posts only those standards that 
have become law. See SMF ^ 40; Malamrrd 

Deck f 33. Consistent with this policy, 

Mr. Malamrrd testified that he wortld consider 
posting the 2014 edition only “[i]f the federal 
government did a deliberate and explicit 
mcorporation by reference,” and only after 
determining “if that was an area that I wanted 
to continrre to mvest resomces in.” ICE Ex. 7 
(Malamrrd Dep. 307; 17-309:03). 
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